Papers with automatic approach
FLEEK: Factual Error Detection and Correction with Evidence Retrieved from External Knowledge (2023.emnlp-demo)
Copied to clipboard
Farima Fatahi Bayat, Kun Qian, Benjamin Han, Yisi Sang, Anton Belyy, Samira Khorshidi, Fei Wu, Ihab Ilyas, Yunyao Li
| Challenge: | Existing large language models (LLMs) have a tendency to hallucinate and provide creative and fluent responses that are not factually accurate. |
| Approach: | They propose a tool that automatically extracts factual claims from text, gathers evidence from external knowledge sources, evaluates the factuality of each claim, and suggests revisions for identified errors. |
| Outcome: | The proposed tool detects errors in text and evaluates their factuality and suggests revisions based on the collected evidence. |
SELFGOAL: Your Language Agents Already Know How to Achieve High-level Goals (2025.naacl-long)
Copied to clipboard
Ruihan Yang, Jiangjie Chen, Yikai Zhang, Siyu Yuan, Aili Chen, Kyle Richardson, Yanghua Xiao, Deqing Yang
| Challenge: | Existing approaches to improve the performance of language agents without training are not available. |
| Approach: | They propose an automatic approach to break down high-level goals into tree structure of more practical subgoals during interaction with environments while identifying the most useful subgoal. |
| Outcome: | The proposed approach significantly improves the performance of language agents across various tasks, including competitive, cooperative, and deferred feedback environments. |
SW4ALL: a CEFR Classified and Aligned Corpus for Language Learning (L18-1)
Copied to clipboard
| Challenge: | Learning a second language requires exposition to texts, especially for the acquisition of vocabulary. |
| Approach: | They propose a corpus of documents classified by language proficiency level . they use alignments between the English Wikipedia and the Simple English Wikipedia . |
| Outcome: | The SW4ALL corpus contains 8,669 pairs of documents that present different levels of proficiency. |
Understanding the Therapeutic Relationship between Counselors and Clients in Online Text-based Counseling using LLMs (2024.findings-emnlp)
Copied to clipboard
| Challenge: | In traditional face-to-face therapy, the assessment of therapeutic alliance is not directly translated to text-based settings. |
| Approach: | They propose an automatic approach to understand the development of therapeutic alliance in text-based counseling by using large language models. |
| Outcome: | The proposed approach demonstrates that the framework is effective in identifying the therapeutic alliance in text-based counseling. |
Transfer of Frames from English FrameNet to Construct Chinese FrameNet: A Bilingual Corpus-Based Approach (L18-1)
Copied to clipboard
| Challenge: | Current publicly available Chinese FrameNet has a relatively low coverage of frames and lexical units compared with other languages. |
| Approach: | They propose an automatic way to construct Chinese FrameNet using a sentence-aligned English-Chinese bilingual corpus. |
| Outcome: | The proposed resource can provide frame recommendations acceptable by annotators. |
Corpus-based Content Construction (C18-1)
Copied to clipboard
| Challenge: | Existing work in this direction focuses on generating content for standard platforms like Wikipedia, where the content style is fairly consistent, but there could be multiple representations of the same information across the repository. |
| Approach: | They propose an automatic approach to generate an initial version of the author’s intended text based on an input content snippet. |
| Outcome: | The proposed approach improves performance against baselines on several metrics. |
Dysarthric speech evaluation: automatic and perceptual approaches (L18-1)
Copied to clipboard
| Challenge: | Perceptual evaluation is still the most common method in clinical practice for the diagnosis and monitoring of the condition progression of people suffering from dysarthria. |
| Approach: | They propose an automatic approach for anomaly detection at the phone level for dysarthric speech . they propose a perceptual evaluation protocol that uses annotated french corpora to analyze the system behavior. |
| Outcome: | The proposed method was validated on different corpora and speech styles. |
Cross-Lingual Cross-Platform Rumor Verification Pivoting on Multimedia Content (D18-1)
Copied to clipboard
| Challenge: | rumors with multimedia content are becoming more and more common on social networks . a new feature set is proposed to verify rumors pivoting on multimedia content . |
| Approach: | They propose to use multimedia content to find external information on social media platforms . they propose to leverage semantic similarity between rumors and external information . |
| Outcome: | The proposed approach achieves state-of-the-art results on social networks . it leverages semantic similarity between rumors and external information . |
Sarcasm Target Identification: Dataset and An Introductory Approach (L18-1)
Copied to clipboard
| Challenge: | Past work on sarcasm detection has focused on identifying the sarcasm target of ridicule in a sarkastic text. |
| Approach: | They propose a task of extracting the sarcastic target of ridicule from a sarcastical text using a manually annotated dataset and an automatic approach. |
| Outcome: | The proposed approach establishes the viability of sarcasm target identification and will serve as a baseline for future work. |